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INTERNAL  ANALYSIS  OF  THE  GROUP  AWARENESS  TEST  FOR  THE 
DIFFERENTIAL  OFFICER  BATTERY 


V 


BACKGROUND 


The  Group  Awareness  Test  was  developed  as  part  of  an  extensive  program 
of  research  to  determine  the  extent  to  which  ability  to  meet  the  psycholo¬ 
gical  demands  of  combat,  administrative,  and  technical  officer  assignments 
can  be  differentially  predicted  by  psychological  measures.)  As  the  first 
step  of  this  program,  an  extensive  battery  of  experimental  tests  was  con¬ 
structed  and  administered  to  over  6000  officers  at  entry  on  active  duty 
in  1958.  7  On  the  basis  of  item  analysis  against  performance  ratings  after 
about  18  months  of  service,  the  earlier  battery — the  Differential  Officer 
Leadership  Battery  (DOL)--was  revised  and  shortened  to  form  the  Differential 
Officer  Battery  (DOB).  ^  In  1961  and  1962,  the  DOB  was  administered  to  about 
4000  officers  at  entry  on  active  duty.  The  instruments  of  the  DOB  are  being 
validated  in  two  broad  /types  of  criterion  situation:  1)  carefully  standard¬ 
ized  measures  making  ufc  an  integrated  exercise  administered  in  a  simulated 
combat  environment  at  the  Officer  Evaluation  Center  established  for  the 
purpose;  and  2)  ratings  of  performance  in  both  active  combat  theater  oper¬ 
ations  in  Vietnam  and  in  combat  readiness  operations  in  Korea,  Europe,  and 
CONUS . 


OBJECTIVE 

/ 

t  The  Group  Awareness  Test  (GAT)  was  included  in  the  experimental  DOL 
in  an  effort  to  measure  the  officer's  empathy  or  ability  to  estimate  the 
•opinions  of  peers  and  subordinates.  '"As  first  constructed1-',  the  GAT  con¬ 
sisted  of  two  forms,  A  (DA  PT  3400)  and^B  -{DA  PT  3401),  each  composed  of 
75  job  related  attitudinal  statements.  When^the  DOL  was  revised  and 
shortened  to  form  the  DOB,  the  GAT  was  reduced  to  a  single  form  of  75  items 
(DA  PT  4093)^.  The  items  are  all  statements  of  opinion  or  attitude  with 
regard  to  work  habits,  leader-follower  relationships,  human  nature,  and 
various  kinds  of  pursuits  and  activities.  The  examinee  is  instructed  to 
estimate  for  each  statement  what  proportion  of  a  representative  group  of 
NCOs,  recruits,  and  ROTC  graduates  would  Indorse  the  statement.  There  are 
thus  three  responses  to  each  of  the  75  items,  producing  a  total  of  225 
scorable  responses.  The  format  for  responding  is  such  that  each  item  on 
the  answer  sheet  is  followed  by  three  rows  of  five  alternatives.  In  each 
row,  the  alternatives  are  represented  by  the  letters  A,  B,  C,  D,  E. 


Bornstein,  H.,  R.  Sadacca,  and  R.  Phillips.  Development  of  differential 
officer  leadership  experimental  test  battery.  Research  Memorandum  57-27. 
December  1967* 

^Willemin,  L.  P.  Prediction  of  officer  performance.  Technical  Research 
Report  1134.  March  1964. 
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At  the  top  of  each  page  of  the  test  booklet,  the  following  code  for  the 
alternatives  is  printed:  A  ■  Very  few  (0$  -  19^) ;  B  ■  Few  (2D$  -  39$); 

C  “  About  half  (40$  -  59$) '>  D  *  Many  (60$  -  79$);  E  =  Very  many  (80$  - 

100$)  . 

/The  present  Research  Memorandum  describes  the  internal  analysis  of 
the  GAT,  as  revised,  for  the  purpose  of  deriving  psychologically  homoge¬ 
neous  scales  for  scoring  the  instrument.  Specific  objectives  were: 

1)  to  identify  relatively  independent  factors  which  can  be  reliably  based 
on  exclusive  sets  of  items  in  the  GAT;/2)  to  relate  such  factor  scales 
to  each  other  and  determine  to  what  extent  such  factors  correspond  to  the 
major  hypothesized  dimensions  of  combat,  administrative,  and  technical 
requirements;  and  J>)  to  select  scales  for  scoring  and  validation  in  sub¬ 
sequent  research. 


PROCEDURES 


SAMPLE 

For  this  study  and  for  others  involving  internal  analysis  of  other 
DOB  measures,  a  stratified  sample  of  900  cases  was  selected  from  the  4000 
to  whom  the  DOB  was  administered,  100  cases  being  randomly  selected  from 
each  of  nine  branches  of  service:  Infantry,  Armor,  Artillery,  Engineer, 
Signal  Corps,  Ordnance,  Quartermaster  Corps,  The  Adjutant  General,  and 
Finance. 


ANALYSIS  OF  GAT  RESPONSES 

As  a  first  step,  frequency  distributions  for  the  five  response  cate¬ 
gories  of  each  of  the  225  items  In  the  GAT  were  prepared.  None  of  these 
distributions  was  considered  sufficiently  skewed  to  preclude  calculation 
of  product-moment  correlation  coefficients.  Intercorrelation  matrices 
(Pearsonian  r)  were  prepared  for  the  75  items  separately  for  each  of  the 
three  estimation  populations--NC0,  recruit,  and  R0TC  graduates.  These 
matrices  were  then  factor  analyzed,  using  the  principal  axes  method. 

Twenty  factors  were  extracted  from  each  of  the  three  matrices  and  succes¬ 
sively  greater  numbers  of  factors  were  rotated,  by  the  varimax  method, 
beginning  with  2  and  terminating  with  15.  All  possible  pairs  of  factors 
from  the  three  15“factor  rotations  were  correlated  according  to  their 
factor  loadings,,  resulting  in  a  45  by  45  matrix. 

While  the  factors  seemed  generally  interpretable,  most  of  them  were 
defined  by  few  items.  For  each  of  the  populations,  the  largest  proportion 
of  variance  was  accounted  for  by  the  first  factor.  The  items  loadings  on 
this  factor,  while  congruent  across  the  three  estimation  populations,  were 
somewhat  heterogeneous  in  content.  The  characteristic  all  seemed  to  have 
in  common  was  a  sort  of  unassailable  wisdom.  Put  another  way,  they  had  a 
considerable  loading  of  social  desirability.  Proportions  of  responses 
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obtained  with  the  opinion  survey  described  below  verified  this  interpre¬ 
tation.  Nearly  all  the  items  with  significant  loadings  on  factor  I 
produced  very  high  levels  of  agreement.  A  few  of  the  items  negatively 
loaded  on  factor  I  showed  the  opposite  characteristic  of  very  low 
agreement.  The  second  factor  in  all  three  estimation  populations,  defined 
by  fewer  items,  also  showed  considerable  congruence  over  the  three 
analyses.  These  items  had  in  common  a  general  cynicism  toward  human 
characteristics.  Beyond  the  first  two  factors,  no  factors  showed  high 
levels  of  congruence  over  all  three  estimations,  a  characteristic  con¬ 
sidered  desirable  in  the  final  scales  for  operational  use. 


ANALYSIS  OF  ACCURACY  SCORES 

In  further  analysis  utilizing  accuracy  scores,  examinees'  estimates 
of  the  percentages  of  NCOs,  recruits,  and  officers  indorsing  each  GAT 
statement  were  compared  with  percentages  of  NCO,  recruit,  and  officer 
samples  indorsing  the  statement.  The  instrument  for  obtaining  the 
latter  sets  of  data  was  the  General  Opinion  Survey  (GOS).  Two  forms  of 
the  GOS  (PT  3406  and  PT  3407)  corresponding  to  the  earlier  long  forms 
of  the  GAT  were  administered  in  late  1959  and  I960  to  approximately 
400  men  in  each  category.  Responses  to  those  items  which  were  included 
in  the  revised  GAT  were  tabulated  to  provide  a  standard  against  which 
to  calculate  the  accuracy  of  estimates  by  officers  taking  the  GAT.  A 
scoring  key  for  the  GAT  was  made  up  based  on  the  accuracy  with  which  the 
responses  of  NCOs,  recruits,  and  officers  (as  given  in  the  GOS)  were 
estimated.  A  response  alternative  was  keyed  as  correct  if  the  percent¬ 
age  of  agreement  in  the  GOS  fell  within  the  limits  assigned  to  that 
alternative  in  the  GAT  code,  whether  the  actual  percentage  fell  in  the 
middle  of  the  interval  or  at  one  of  the  extremes.  For  6  items,  both  the 
A  and  B  responses  were  keyed  as  correct,  since  keying  only  the  A  response 
would  have  resulted  in  a  p-value  of  less  than  .05. 

Each  of  the  225  responses  of  the  $00  men  in  the  present  sample  were 
scored  as  either  right  or  wrong  according  to  the  key.  Next,  all  225 
responses  were  intercorrelated  in  a  single  matrix,  using  tetrachoric  r. 

This  matrix  was  then  factor  analyzed  by  the  principal  axes  method.  Twenty 
factors  were  extracted.  Beginning  with  the  first  two  factors,  successively 
larger  combinations  of  factors  were  rotated,  using  the  varimax  method, 
until  all  2D  factors  had  been  rotated. 

The  first  factor,  stable  through  all  the  rotations,  corresponded 
closely  -to  the  first  factor  obtained  in  each  of  the  three  analyses  of 
estimation  responses.  This  result  is  not  surprising,  since  the  items  had 
common  variance  in  the  response  patterns  and  also  shared  similar  agreement 
patterns  in  the  percentages  which  went  to  make  up  the  key.  In  nearly  all 
cases  when  an  estimate  of  agreement  for  one  of  the  three  populations  was 
significantly  loaded  on  this  first  factor,  the  estimates  for  the  other 
two  populations  were  similarly  loaded. 
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lU'vi'ihl  llu*  i  lfttl  mrinr,  Liu*  other  Inctorn  wore  not  Interpret  able  on 
s  !i«-  ImsIh  oi  itom  coni  out.  oilier  l'.ictor»  appeared  In  the  pattern  of 
ke\e»l  ro-sponsuM,  buL  L  lie  Hi*  paLternn  did  not  appear  psychological  ly  meanlng- 
sol.  Only  the  first  factor  seemed  to  reflect  patterns  uncovered  in  the 
uu.il vsos  of  CAT  responses.  The  factor  of  cynicism  toward  human  nature, 
which  emerged  rather  clenrlv  from  the  raw  responses,  was  not  apparent  in 
the  analysis  of  accuracy  scores.  The  number  of  intercom* lai Ions  above  .7; 
was  very  low,  and  most  of  these  involved  items  loaded  on  the  first  factor. 
It  was  concluded  that  the  superimposition  of  the  scoring  key  on  the 
responses  had  masked  any  patterning  which  might  have  been  meaningful, 
with  the  exception  of  tin;  social  desirability  represented  by  the  first 
factor  in  all  the  analyses. 


ADDITIONAL  SCORING  PROCEDURES 

In  view  of  the  lack  of  success  in  finding  clear  subscales  among  the 
GAT  responses  or  the  accuracy  scores,  only  two  alternatives  seemed  avail¬ 
able  for  clustering  the  items  of  the  CAT:  The  items  could  be  classified 
in  terms  of  patterns  of  responses  for  the  three  samples  who  were  adminis¬ 
tered  the  GOS,  or  in  terms  of  judged  content  of  the  items  without  regard 
to  patterning  of  responses  in  either  GAT  or  GOS. 

In  the  item  key  based  upon  responses  to  the  GOS,  the  items  fell  into 
several  categories  with  possible  significance  for  scoring.  Of  the  75  GAT 
statements,  15  were  indorsed  by  80$  or  more  of  the  men  in  all  three  popu¬ 
lations  and  were  therefore  keyed  for  the  E  estimation  responses  in  all 
three  cases.  An  additional  4  items  were  indorsed  by  less  than  20°f>  of 
the  men  in  each  of  the  three  populations  and  were  keyed  for  the  A  response. 
These  19  items  (referred  to  as  the  extreme  or  EX  cluster)  would  be  expected 
to  be  involved  in  scores  influenced  by  generalized  position  response 
tendencies.  There  are  15  more  items  which  received  similar  responses 
across  the  three  estimation  populations  but  which  were  not  at  the  two 
extremes  (the  middle  or  MI  cluster).  Of  these,  2  were  keyed  for  the 
B  response,  5  for  the  C  response,  and  8  for  the  D  response.  It  is  possi¬ 
ble  that  scales  could  be  constructed  using  combinations  of  these  items 
which  either  cancel  cr  at  least  account  for  response  tendencies  not  related 
to  item  content  or  to  the  population  being  estimated. 

.  Of  the  remaining  items,  9  show  a  pattern  of  response,  using  the  key 
based  on  GOS  responses,  pairing  the  two  leadership  groups,  NCOs  and  recently 
commissioned  officers.  For  these  items  (labeled  the  CO  cluster),  proportions 
of  agreement  for  the  officer  and  NCO  groups  were  within  a  few  percentage 
points  of  each  other  and  the  keyed  alternatives  were  the  same;  the  propor¬ 
tion  for  recruits,  on  the  other  hand,  was  either  higher  or  lower  by  a 
substantially  larger  margin  and  resulted  in  the  keying  of  a  different  alter¬ 
native.  (On  four  of  these  items  the  recruit  proportion  of  agreement  was 
lower,  on  five  items  higher  than  that  of  the  other  two  groups).  It  could  be 
argued  that  these  items  represent  statements  which  differentiate  leadership 
and  nonleadership  groups.  An  additional  12  items  paired  the  GOS  responses 
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■of  the  two  enl luted  groups  {recruits  and  NCOs)  and  differentiated  them 
from  the  responses  of  officers.  Those  items  (labeled  the  enlisted  or 
EN  cluster)  fit  the  same  criteria  as  those  pairing  the  two  leadership 
groups  against  recruits.  On  two  of  those  items,  agreement  by  officers 
was  higher  than  that  of  the  other  two  groups,  and  on  ten  it  was  lower. 

These  items  appear  to  differentiate  between  officers  and  enlisted  men. 

There  was  only  one  COS  item  on  which  recruits  were  paired  with  officers 
and  differed  from  NCOs.  On  6  items,  the  responses  of  the  three  popu¬ 
lations  on  GOS  were  substantially  different  for  all  three  groups  (labeled 
the  all  different  cr  AD  cluster).  On  4  of  these  items,  recruits  showed 
the  highest  degree  of  indorsement  with  NCOs  next  and  officers  lowest. 

The  four  with  similar  patterns  might  possibly  represent  degree  of  respon¬ 
sibility,  degree  of  ability,  or  simply  amount  of  education.  On  one  of 
the  two  other  items,  proportions  of  agreement  from  highest  to  lowest  were 
for  NCOs,  recruits,  officers--on  the  other,  officers,  recruits,  NCOs. 

It  is  hard  to  know  what  these  items  represent.  The  remaining  13  items 
could  not  be  fitted  into  any  of  the  preceding  categories.  Although  the 
keyed  responses  differed,  differences  in  percentage  of  agreement  were 
small. 

In  still  another  procedure,  items  were  sorted  subjectively  in  terms 
of  content.  On  this  basis,  63  of  the  items  were  sorted  into  10  scales: 

(1)  Common  man,  4  items;  (2)  Conservative  virtue,  3  items;  (3)  Health, 

3  items;  (4)  Technical  crafts,  9  items;  (5)  Enjoyment  of  living,  6  items; 

(6)  Independence  and  personal  freedom,  8  items;  (7)  Manipulative  social 
relations,  10  items;  (8)  Attitudes  toward  war,  3  items;  (9)  Faith  in 
Army  leadership,  6  items;  (10)  Soldier  duty,  9  items. 

To  assess  the  possible  use  of  scales  based  upon  item  clustering  by 
GOS  responses  and  by  subjective  item  sorting,  a  random  sample  of  100  cases 
taken  from  the  900  described  above  were  scored  on  the  two  sets  of  scales. 

The  EX  cluster  was  also  scored  in  terms  of  the  average  response  estimate 
given,  assigning  values  of  1  through  5  to  alternatives  A  through  E,  re¬ 
spectively.  The  order  of  values  assigned  to  the  alternatives  for  items 
keyed  A  for  all  groups  was  reversed.  The  MI  cluster  was  also  scored  in 
terms  of  the  average  directional  deviation  from  the  keyed  value.  Each  of 
"these  scales  was  scored  for  each  of  the  three  estimation  populations,  NCO, 
recruit,  and  R0TC  graduate.  In  addition  to  these  scores,  a  total  rights 
score  was  obtained  for  each  of  the  estimation  populations  over  the  73  items. 
Three  scores  were  also  computed  to  show  the  degree  to  which  the  estimates 
of  the  examinees  differed  for  two  of  the  estimation  populations  on  those 
items  on  which  the  GOS  responses  showed  that  the  two  populations  actually 
did  differ.  In  each  case,  this  score  was  a  ratio  of  amount  of  difference 
in  the  estimates  for  those  items  which  did  show  a  difference  in  GOS  response 
to  those  which  did  not.  The  three  scores  were:  1)  recruits  versus 
officers,  2)  NCOs  versus  officers,  and  3)  recruits  versus  NCOs. 

The  means  and  standard  deviations  of  each  of  these  57  trial  scores 
were  computed  and  the  scores  were  intercorrelated  using  product -moment  r. 

The  means  and  standard  deviations  revealed  a  consistent  tendency  for  the 
estimates  of  officers  to  rank  at  the  top,  of  NCOs  next,  and  of  recruits 
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at  tha  bottom  in  tarn*  of  both  accuracy  and  ganaral  aoclal  desirability. 
Scoraa  on  good  health,  enjoyment  of  living,  eoldler  duty,  and  almllar 
concepta  were  high  for  recruits  and  low  for  officers.  This  patterning 
of  means,  along  with  the  lntercorrelatlons,  suggested  that  the  scales 
were  not  measuring  much  that  was  Independent  of  general  overall  accuracy 
or  social  desirability. 


DERIVING  THE  FINAL  SCALES 

Since  the  factor  analyses  of  the  estimation  responses  for  each  of 
the  three  populations  had  provided  at  least  two  scales,  social  desirability 
and  cynical  view  of  human  nature,  it  was  determined  to  go  back  to  these 
analyses  to  see  whether  other  scales  could  be  derived  even  if  they  could 
be  scored  for  only  one  or  two  of  the  estimation  populations.  Since  the 
later  emerging  factors  were  typically  defined  by  only  one  or  two  items, 
the  five-factor  rotations  were  chosen  as  the  focus  for  investigation. 

In  all  three  analyses,  the  root  for  the  sixth  factor  extracted  was  the  first 
to  have  a  value. of  less  than  one.  Table  1  gives  descriptive  titles  for 
the  factors  in  the  three  five-factor  rotations. 

Using  the  loadings  from  the  five-factor  rotations,  it  proved  possible 
to  cluster  61  of  the  75  items  into  8  scales,  based  on  patterns  of  loadings. 
While  most  of  these  scales  can  hardly  be  called  factorially  pure,  they 
do  show  considerable  content  homogeneity,  at  the  same  time  having  at  least 
minimal  factorial  Justification.  The  rationale  for  grouping  is  given 
below,  along  with  a  description  of  scale  content.  The  three  five-factor 
rotations  are  presented  as  tables  A-l,  A-2,  and  A-3.  The  scales  with  GOS 
keys  are  given  in  Table  A-4. 


SCORING  GAT  SCALES  IN  DOL 

The  6000  men  who  took  the  earlier  predictor  battery,  DOL,  received 
only  one  of  the  two  earlier  forms  of  GAT,  Form  A  or  Form  B.  Since  the 
75  items  making  up  the  DOB  form  of  the  GAT  were  taken  from  both  forms, 
these  men  were  not  exposed  to  all  of  the  items  making  up  the  8  scales. 

For  some  scales  the  forms  contained  a  sufficient  number  of  items  to  be 
scorable  in  the  validation  analysis  of  the  DOL.  Other  scales  will  have 
to  be  omitted.  Table  A-5  gives  the  scales  for  each  of  the  GAT  forms  and 
indicates  those  which  will  be  scored  and  validated  for  the  men  receiving 
each  form. 

Scale  1  (Good  work  habits).  This  scale  contains  8  items,  all  of 
which  load  most  heavily  on  factor  I  for  all  three  estimation  populations. 
All  the  items  refer  to  the  desirability  of  quiet,  selfless  dedication  to 
work,  being  careful  in  work,  taking  care  of  machinery,  not  being  a  glory 
hunter,  working  neatly,  etc.  This  scale  most  clearly  represents  the  first 
and  major  factor  which  has  been  referred  to  above  as  social  desirability, 
although  other  scales  contain  items  loading  highly  on  this  factor. 
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Tab to  I 


THE  FIRST  FIVE  FACTORS  IN  ANALYSIS  OP  CAT  ESTIMATES  FOR 
NCO,  RECRUIT,  AND  ROTC  POPULATIONS 

NCO  Analysis 

Factor  I  Social  Desirability  (Unassailable  Wisdom) 

Factor  II  Cynical  View  of  Human  Nature 

Factor  III  Educated  Sophistication 

Factor  IV  Individual  Toughness  (Authoritarianism) 

Factor  V  (Uninterpretable) 


Factor  I 
Factor  II 
Factor  III 
Factor  IV 

Factor  V 


Recruit  Analysis 


Social  Desirability  (Unassailable  Wisdom) 

Cynical  View  of  Human  Nature 
Educated  Sophistication 

Human  Relations  at  Work  (Leadership)  and  Play  (Social  and 
Family) 

Individual  Toughness  (Without  Authoritarianism) 


Factor  I 
Factor  II 
Factor  III 
Factor  IV 
Factor  V 


Scale  2  (Leader* follower  relatione).  Thia  acale  contains  9  items, 
and  again  the  items  load  heavily  on  factor  I  for  all  three  groups.  The 
rationale  for  selecting  these  items  as  a  separate  scale,  aside  from  the 
homogeneity  of  content,  is  that  in  the  recruit  estimation  population  all 
these  items  shoved  dual  loadings  on  factors  I  and  IV.  For  the  other  two 
estimation  populations,  the  items  clearly  belong  to  Factor  I.  Seven  of 
the  9  items  refer  to  a  working  man,  or  a  soldier,  in  relation  to  a  leader 
or  his  instructions,  or  to  the  organization. 

Scale  ^  (Fighting  man's  codej.  The  six  items  of  this  scale  were 
grouped  because  of  similar  factor  loading  patterns  in  the  NCO  and  officer 
estimation  populations.  In  the  analysis  based  on  estimates  of  NCO 
responses,  all  six  items  showed  substantial  loadings  on  faetors  I  and  IV, 
and  in  the  analysis  of  officer  estimates  all  but  one  showed  loadings 
on  factors  I  and  III  (IV  in  the  NCO  analysis  being  the  same  as  III  in  the 
officer  analyses) .  The  remaining  item  showed  a  substantial  loading  on 
only  factor  III  for  officer  estimates.  In  the  recruit  estimate  analysis, 
the  loadings  for  these  items  were  predominantly  on  factor  I  alone,  although 
two  items  also  showed  substantial  loadings  on  factor  V.  Three  items  refer 
to  the  value  of  fresh  air,  exercise,  and  physical  conditioning,  two  favor 
unquestioning  obedience  to  orders,  and  tha  final  item  is  a  statement  in 
favor  of  universal  combat  training  for  soldiers.  The  package  seems  tc  relate 
to  some  form  of  authoritarian  syndrome,  but  the  support  for  such  an  inter¬ 
pretation  is  not  compelling. 

Scale  4  (Marriage  and  family).  Only  three  items  make  up  this  scale, 
and  once  again  the  factor  loadings  for  tha  recruit  estimates  are  respon¬ 
sible  for  their  separation.  For  the  NCO  and  officer  estimates,  the  load¬ 
ing*  on  factor  1  predominate  for  each  item,  while  for  two  of  the  items  the 
only  substantial  recruit  estimate  factor  loading  is  on  factor  IV.  The 
largest  recruit  estimate  loadings  for  the  third  item  (item  t.'5)  were  on 
factors  I  and  IV,  with  the  loading  on  factor  I  predominating.  The  three 
Items  all  deal  with  family  and  marriage,  one  with  visiting  the  folks,  one 
with  family  and  children  as  a  source  of  satisfaction,  and  one  with  dating 
many  girls  before  marriage. 

Scale  *5  (Cynical  view  of  human  nature).  Of  all  the  scales,  this  is 
probably  the  clearest  and  most  well  defined.  All  l?  items-  had  their  highest 
loading  on  factor  II  for  all  three  estimation  populations,  and  in  nearly 
all  cases  thia  was  either  the  only  substantial  factor  loading  or  clearly 
predominated.  The  items  all  represent  a  rather  jaundiced  view  of  human 
nature  and  range  from  getting  on  Che  good  aide  of  the  boss  to  indicating 
that  a  good  combat  man  need*  more  guts  chan  brains. 

£  (  Educated  sophistication).  This  scale  consists  of  11  items, 
and  was  determined  more  by  factor  clustering  than  by  readily  apparent  item 
content.  In  Che  NCO  estimate  analysis,  all  items  had  their  highest  loading 
on  factor  III;  in  the  recruit  estimate  analysis,  all  were  aubstant ially 
loaded  on  factor  III  and  on  only  one  item  was  this  not  the  highest  loading. 
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In  the  officer  estimate  analysis,  9  of  Che  II  Items  had  their  highest  load* 
lng  on  factor  IV.  The  remaining  two  Items  had  their  highest  loadings  on 
factor  V.  These  two  Items,  Indorsing  golf  and  tennis  as  good  games,  were 
associated  with  hunting,  fishing,  flying,  etc.  in  the  officer  estimates, 
but  In  the  other  two  estimation  populations  were  clustered  very  definitely 
with  this  scale.  The  golf  Item  did  have  a  loading  of  .21  on  factor  IV 
In  the  officer  estimates,  but  the  loading  of  the  same  item  was  .4<q  on 
factor  V.  The  two  items  were  Included  In  this  scale  largely  on  the  basis 
of  strong  Indications  of  their  belonging  found  In  the  NCO  and  recruit 
estimation  analyses.  The  content  of  the  remaining  items  Is  somewhat  varied. 
Two  Items  state  the  superiority  of  the  technical  man  over  the  combat  man 
In  modern  warfare,  and  one  states  that  reading  technical  material  is  relax¬ 
ing.  Related  Items  state  that  one  who  doesn't  know  the  basic  theory  should 
not  operate  equipment,  and  that  promotions  should  be  given  on  the  basis  of 
examinations .  Other  items  Indorse  visiting  art  museums  and  decry  women's 
smoking  in  public  and  boxing  as  a  brutal  sport.  A  final  and  somewhat 
puzzling  item  states  that  the  moat  Important  thing  In  life  is  to  get  along 
with  everybody.  The  only  thread  which  seems  to  tie  all  the  items  together 
Is  a  sort  of  polite,  educated  sophistication. 

Scale  7  (Personal  integrity).  The  five  items  of  this  scale  were 
grouped  largely  on  the  basis  of  their  factor  loadings  in  the  NCO  and 
officer  estimate  analyses.  In  the  NCO  analysis,  all  items  had  their  only 
substantial  loading  on  factor  IV;  in  the  officer  analysis,  all  had  their 
highest  loading  on  factor  III.  In  the  recruit  estimate  analysis,  the  items 
loaded  on  factor  V  or  I  ( or  both.  In  the  case  of  one  item).  One  item  states 
that  a  man  should  stand  up  for  his  rights,  a  second  that  first  sergeants 
will  back  up  men's  grievances.  Two  other  items  state  that  a  good  man  enjoys 
a  tough  job  and  that  most  men  would  rather  die  fighting  than  be  taken 
prisoner.  The  final  item  states  that  anybody  can  understand  most  Army 
directives.  How  this  last  item  fits  in  conceptually  is  difficult  to  explain 

Scale  8  (Activities).  The  six  items  of  this  scale  have  a  considerable 
degree  of  content  homogeneity.  All  deal  with  activities  which  are  satisfy¬ 
ing,  exciting,  or  enjoyable.  They  refer  variously  to  hunting,  taking 
machinery  apart,  flahing,  doing  dangerous  things,  learning  to  fly,  and 
dancing.  The  factorial  Juat if ication  for  their  grouping  is  not  as  clear. 

In  the  officer  estimation  analysis,  all  these  items  had  their  only  substan¬ 
tial  loading  on  factor  V.  In  the  recruit  analysis,  five  of  the  Items  had 
a  substantial  loading  on  factor  V  and  for  four  of  them  this  was  their  highes 
loading.  In  the  SCO  estimate  analysis,  there  was  no  discernible  patterning. 
Two  of  the  Items  had  their  htgheat  loading  on  factor  I,  two  on  iactor  III, 
and  two  on  factor  IV.  In  a  sample  of  100  on  whoa  these  scales  were  scored, 
the  NCO  estimate  score  correlated  .61  with  the  recruit  estimate  score  and 
.?*>  with  the  officer  estimate  score.  These  coefficients  were  as  high  as 
the  corresponding  intercorrelati&na  for  any  of  the  other  scales,  and  higher 
than  most . 
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Tiic  remaining  1*1  items  were  not  nnulgnc'1  to  mcoIck.  Tin.*  Items  ore 
<»»»*  ,  v<mi  ambiguous  In  Unit  llicy  loml  LhcmMetvcH  to  Mcvcrnl  po»;»il>le  inter* 
-M.  t.it  Ion*.  Hu*  Intercorrolnt Ion  matrix  obtained  In  the  Mt-man  nnmplc 
appear*  ni«  Table  A-<  '.  Ah  expected,  HcnlcH  I  through  A,  nil  of  which  had 
loading*  on  factor  1,  Intercorrolate  fairly  highly.  TIichc  Intercorrelo* 
lion*  .ire  not  ho  high  ns  to  prevent  Homo  finding  of  Independent  validity. 
Sea  lea  '  and  »*•  show  n  good  degree  of  independence  from  other  Hcniot*. 

DEVIATION  SCORINO 

In  keeping  with  the  original  purpose  of  developing  an  instrument  which 
measures  the  degree  to  which  the  examinee  can  accurately  estimate  the 
opinions  of  specified  groups  of  coworkers,  a  second  scoring  procedure  was 
developed  for  the  CAT.  In  addition  to  simply  cumulating  the  raw  responses, 
scaled  l  through  •>,  a  deviation  score  can  be  obtained.  This  score  is  cal¬ 
culated  by  subtracting  the  scale  value  of  the  keyed  response,  based  on 
responses  to  the  COS,  from  the  scale  value  of  the  response  itself.  These 
deviation  scores  are  then  cumulated  without  regard  to  sign.  In  the  case 
of  scales  1  through  1,  the  raw  score  and  the  deviation  score  would  be 
rather  highly  correlated  since  the  keyed  responses  tend  to  be  rather  uni¬ 
form  over  the  items  (mostly  D  and  E) .  In  the  case  of  the  other  scales, 
correlation  between  the  raw  scores  and  the  deviation  scores  would  be  rela¬ 
tively  low.  The  raw  scores  would  be  an  indication  of  the  examinee's  regard 
for  the  population  he  is  estimating--NCOs,  recruits,  or  officers.  The 
deviation  score  would  be  a  measure  of  his  accuracy  in  estimating  what  the 
group's  responses  actually  are. 


CONCLUSIONS 

In  terms  of  the  objectives  of  this  project,  it  appears  that  the 
following  results  have  been  achieved:  1)  Eight  scales  have  been  con¬ 
structed  from  loadings  on  five  factors  extracted  separately  fov  the  NCO, 
recruit,  and  officer  estimation  populations.  2)  Four  of  these  scales  are 
rather  highly  intercorrelated  since  they  all  contain  items  loaded  signifi¬ 
cantly  on  the  first  factor,  usually  in  combination  with  loadings  on  other 
factors.  The  remaining  four  scales  are  quite  independent,  with  two  appear¬ 
ing  to  represent  rather  pure  factors.  In  general,  the  scales  represent 
adequately  the  factor  structure  of  the  total  instrument,  although  with 
only  moderate  factorial  purity.  3)  The  scales  derived  do  not  clearly 
represent  the  three  areas  of  officer  assignment--combat,  administrative, 
and  technical.  .The  items  assigned  to  these  areas  on  an  a  priori  judgment 
basis  are  rather  evenly  distributed  within  each  of  the  scales.  Whether 
any  differential  prediction  is  possible  with  either  raw  response  scoring 
or  deviation  scoring  will  have  to  be  empirically  determined. 

Independent  estimates  of  the  reliability  of  these  scales  will  be 
obtained  in  a  new  sample.  Data  have  also  been  obtained  by  which  to  deter¬ 
mine  the  effectiveness  of  the  scales  in  predicting  success  in  the  perform¬ 
ance  exercise  conducted  at  the  Officer  Evaluation  Center,  in  combat  in 
Vietnam,  and  in  combat-ready  units  in  Korea,  Europe,  and  CONUS. 
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APPENDIX 


Tables 


A-l.  GAT  5-factor  rotation  for  NCO  estimates 

A-2.  GAT  5'factor  rotation  for  rec  uit  estimates 

A-3.  GAT  5*factor  rotation  for  ROTC  estimates 

A-4.  Scoring  Keys  for  final  GAT  scales 

A-5.  Scoring  Keys  for  final  GAT  scales  in  two  DOL  forms 

A-6.  Intercorrelation  of  GAT  subscorrs  in  100-case  sample 
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Part  II.  ttOTATCD  FACTOR  LOADIHCS 


UA 


ft 

O  f\i 


ru 

3 

9 

o 

I 


o 


>c 


o 


ru  m  o\  (Vj 

O  O  o  — 


if  Oi  CD  OD  -f 

P  O  <*>  —  — • 


in 


a  o 

«  I 


£ 


i 


-•  "1  ♦  if) 

o  -o  o  -c  o 


4)  <■>-  c 

c  -a  -o 


-  19  - 


Part  I.  VARIMAX  ROTATION  ANALYSIS 
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Table  A-4 


SCORING  KEYS  FOR  FINAL  GAT  SCALES 


Scales 

Item 

No. 

Item 

No. 

I  tem 
No. 

Keyed  Alt. 

Number  Title 

NCO 

REC 

rotc 

NCO 

REC 

ROTC 

NCO 

REC 

ROTC 

1. 

1 

Good  Work  Habit a 

3 

E 
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Decin.al  points  are  emitted  in  the  correlation  coefficients. 


